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AUTOMATED SYSTEM FOR IMAGING ARTIFICIAL TISSUE 
CONSTRUCTS IN A CONTROLLED ENVIRONMENT 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

[0001] The system of the present invention is directed to a computer-implemented 
method and system for imaging tissue constructs in a controlled environment in the field of 
tissue engineering and cell biology, but could be used in any applications where 
programmable, automated imaging functions would be useful. 

2. Background of the Invention 

[0002] In the field of tissue engineering, changes in 3D cell-matrix constructs over time 
are frequently studied. Typically, the cells within these constructs will begin to form 
attachments within a day after plating and will reorganize and contract the matrix within a 
few days. Measurements of matrix contraction under the influence of various physical and 
biochemical factors indicate the impact of each factor on cellular function. 
[0003] Currently, measurements of matrix contraction are performed manually by 
periodically moving the culture plates from their controlled environment (inside an incubator) 
to access an external imaging device (camera or scanner). Depending on the effect being 
measured, this process may need to be repeated every few hours, day and night, for several 
days. In addition to being labor intensive, this process is also less than ideal for the cell 
cultures themselves. Preferably, the contraction of the constructs would be monitored 
without repeatedly exposing the constructs to dramatic environmental changes. 

DESCRIPTION OF THE INVENTION 
[0004] The system of the present invention incorporates an imaging device and a 
software program, which together allow the user to automatically monitor matrix contraction 
without removing the cell cultures from the incubator (see Figure 1). The scanner is set up 
inside the incubator with the cell culture plates placed on the scanner glass and the controller 
(computer with custom software, see Figure 2) connected and running nearby. The user 
inputs the desired scanning parameters (filename and type, resolution, etc), selects the scan 
area, and creates a scanning regimen. Once the program is launched, it will automatically 
initiate scans at the times indicated by this regimen, and the culture plates need only be 
removed from the incubator for steps such as media changes (in lengthy studies). The images 
are stored to a user-designated folder for future analysis or may, with additional computer 
processing, be automatically analyzed. Multiple imaging devices can be controlled from a 
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single computer/application to increase the number of culture plates that can be monitored. 

With the appropriate imaging devices and lighting variations (visible light, IR, UV), this 

application could also be extended to monitor changes at the cellular level, including 

performing analyses based on color distinctions. Block diagrams of the scanning function 

software (Figs. 3-9) and frequency set up software (Figs 10-17) are attached. 

[0005] The computer-implemented method and automated system is embodied in the 

form of an executable software program, preferably with a Graphical User Interface (GUI). 

« 

The user interfaces with the GUI and interacts with the method and system of the present 
invention. The software program of the present invention may also interact with or execute 
using other enabling and/or proprietary software, such as LabVEEW™ by National 
Instruments. Various screenshots of the present computer-implemented method, executing in 
conjunction with Lab VIEW™, are illustrated in Figs. 18-27. 

EXAMPLE 

[0006] Various illustrations, photographs, charts and text created in connection with the 
following example are illustrated in Figs. 28-34. Human tendon internal fibroblasts (HTIF, 2 
x 10 5 cells/ 100 |il/specimen) were plated in linear, tethered, collagen gels in TISSUE 
TRAIN™ culture plates. After two hours, when the gels had solidified, the culture plates 
were removed from the FX-4400TT TISSUE TRAIN™ Culture System and placed on the 
glass of a Plustek OpticPro U24 flatbed scanner. The scanner was configured to collect 
images every hour for the first four hours of each day and every two hours for the remainder 
of the day, for four days. Culture plates were only removed from the incubator once a day to 
change the medium. Images were imported into SigmaScan Software to quantify the area of 
each gel at each time point. Gels experienced the greatest rate of contraction (58.6%) in the 
first 24 hours, and continued contracting to a total of 73.6% by the end of Day 4. The 
measured contraction of the gels followed a trend consistent with contraction results obtained 
by traditional methods. Besides simplifying the monitoring process, however, experimental 
results should be more accurate with automated imaging. Any confounding results deriving 
from changes in temperature/pH are minimized when the cultures can remain in the incubator 
during imaging. Additionally, the increased number of data points collected improves the 
resolution of the contraction curve and strengthens the findings. This method can easily be 
applied to perform contraction analysis with other 3D gel systems, as well. 
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Figure 1: Components of Imaging System 
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Figure 2: Flowchart of one simple embodiment of the software function 
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| For tha most current list of patents covering this product, please refer to 
ri .com/legal/pa tents . 

The LabVIEW software is covered by one or more of the following Patents: 
i United States Patent No(s): 4,901,221; 4,914,568; 5,291,537; 5,301,301; 
5,301,336; 5,475,851; 5,481, 740; 5,431,741; 5,497, 500; 5,504,917; 
5,533,933; 

5,610,323; 5,652,909; 5,732,277; 5,734,363; 5,737,622; 5,764,5*16; 
15,734,275; 

5,821,934; 5,347,953; 5,905,649; 5^920,479; 5,974,254; 5,990,906; 

• 1 6,064,316; 6, 102, 965; 6, 133,270; 
§|D3S4}5L?O337750;D33405u;D^4052 
European Patent Ho{s).: 0242131 

I Japanese Patent No{s).: 3,016,733 

i Canadian Patent No(s).: 1235655 

Various other software products may be included with this version of 
Lab VIEW.* If any software products listed below are included, they are 
| covered by various Patents as follows: 



The LabVIEW Signal Processing Toolset is covered by one ormore of the 
following Patents: 

US. Patent No(s).: 5,353,233; 6,103,609 
European Patent No(s}.: 0632899 
Japanese Patent Wofc).: 2,697,957 



|| The LabVIEW Datalogging and Supervisory Control Module is covered by one or 
pjmore of the fbOowing Patents: 

U.S. Patent No(s}.: 5,966,532; 6,053,951 

H LabVIEW Real Time is covered by one or more of the fbOowing Patents: 
U.S. Patent No(s).: 6,173,438 

le LabVIEW PID Control Toolset is covered by one or more af the following 
Patents: 
.S. Patent No{s).: 6,031,751 

I The IVI Driver Toolset is covered by one or more of the following Patents : 
U.S. Patent No(s).: 5,963,725; 6,035,155 



The NI-VISA software is covered by one or more of the foflowing Patents: 
U.S. PatentNofr).: 5,724,272; 5,710,727; 5,847,955; 5,640,572; 5,771^383; 
;,627,933; 5,717,614 



«£ The NI-DAQ software is covered by one or more of the following Patents: 

U.S. Patent No{s).: 5,619,702; 6,067,534; 6,096,094; 6,052,743; 6, 143,433; 
$ 5,926,775; 5,937,530; 6,073,205 

1 

|^ The NI-433 or NI -433.2 yNI^PB) software is covered by one or more of the 
^foltowing Patents: 

I.S. PatentNo(s).: 5,974,541; 5,964,392; 5,953,02S; 5,987,530; 6,073,205 - 



The NI-FBUS software, induding one or more of the NI-FBUS Configurator 
software or the NI-FSJS Monitor software, is covered by one or more of the 
fbOowing Patents: 

US. Patent No(s).: 5,354,390; 5,796,721; 5,350,523; 5,971,531; 6,141,596; 
5,075,952; 5,973,350; 
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/JPEGn 
/LOG 
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/TRANS 
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Set automatic brightness 1 «*0n. 0=0 tf 
Enable automatic feeding of ofccumerits 
Set Brightness to it (very device specific) 
Write.bmp Res (defauftj 
Request 1 -bit black & white 
Set units to centimeters 
Set Contrast to a (very device specific] 
Use duplex scanning 
Select document feeder 
Set gamma ton 
R equest B-brt grayscale 
Display this help text (and exit) 
Ask the imaging device to hide its datog 
Set highlight value * n 
Set Height to scan fin units) 
Set units to hches (default) 

Write tpg ties (JPEG/JRF format) with quality 75 fgoorj) 

Write .ipgfies with quafiyn (1-100) - 

Log internal TWAIN activity to cAertwainbg 

Scan multiple images (up to n) 

Multiple images are saved to Henamel . BenameZ ... 

Request no progress ndScaton 

Don! scan 
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Request 24-W color 

Set Resolution to n in pixels per unit 

Scan an image, even I other options indicate not 
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Display the TWAIN Select Source rfabg (and exit) 

Set Threshold to n 
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Set top edge of the scan area (units from top) 
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/scan 

/shadowlQ 

/s^fuptsu 

/SS 

/T128 

/trans • 

/v 

/WG.2 
/X1.5 
A7.25 



"Automated System for Imaging Artificial Tissue..." 
Albert J. BANES et al. 
Attorney Docket No. 7 1 7-03 1951 





fill 




PI 
o 

• 1—1 
-t— > 

5T 

a 



O 

Ph 
00 





OO 



00 



O 



S 2 is 



00 00 

=t ' 13 £ 

^ £ ^ 3 
13 £ o 3. 

o ft o o 



o 

Csl 



o 

oo 



j. oo 
^ 

ft 



O <D 
O H 



o 

oo 
oo 

a. 



53 



o 
a 




•"9- 



26 




F '$ w BEST AVAILABLE COPY 



"Automated System for Imaging Artificial Tissue..." 
Albert J. BANES et al. 
Attorney Docket No. 7 1 7-03 1 95 1 



; — j CO 

. x 

. ..a 

.03 

i— w 

^ ' 

:S . 

o ^ 
GO bJD 

s s 

..a 

S . 

£ & 

S3 O 

P U 



CO v *^ 

o /o 



CO 



O 
^ jzl 

• 1—1 
fa 03 

<2 S 
fa S 

O <t> 

CO .3 
4} O 

°* . 
S ^ 

o <u 

O n-j 



^_ o 

<D o3 

O <D 

00 

a 
o 

o 



co t2 



o3 
o 

<D 

O, 



co 



o3 



u 

O 
+-> 
03 

o 



a 

o 

> 
o 

s 

5-H 



a- 

§ a 

■s »■ 

£ &0 

co S 
^ O 
O 

O o 



• rH 



o3 



o 

co 

O 
00 
o3 

H g 

oo -S 



o 



o 

-t— » 



o 

o3 



o3 



O <D 



o3 
CD 



co 



o3 
(D 



JO c3 

a £ 



F«3 . 30 



"Automated System for Imaging Artificial Tissue..." 
Albert J. BANES et al. 
Attorney Docket No. 717-03 195 1 




F19 . i 1 BEST AVAILABLE COPY 




F, 3 . 32 BE ST AVAILABLE COPY 



[^Automated System for Imaging Artificial Tissue..." 
Albert J. BANES et al. 
Attorney Docket No. 7 1 7-03 1 95 1 




cm 

^ >-> 

oo x> 
o 



o 

at 

o 

o 



o 



o ^ 

•+-> 

(D y 



o 
o 

<^> 

g 8 
•a ^ 

CO 

O 



CO 

a 




(spxtd) B3iy iva 




p 3 . BEST AVAILABLE COP 



4 



Document made available under the 
Patent Cooperation Treaty (PCT) 

International application number: PCT/US04/035363 
International filing date: 22 October 2004 (22.10.2004) 



Document type: Certified copy of priority document 

Document details: Country/Office: US 

Number: 60/513,355 

Filing date: 22 October 2003 (22.10.2003) 



Date of receipt at the International Bureau: 15 December 2004 (15.12.2004) 



Remark: Priority document submitted or transmitted to the International Bureau in 
compliance with Rule 17.1(a) or (b) 




World Intellectual Property Organization (WEPO) - Geneva, Switzerland 
Organisation Mondiale de la Propriete Intellectuelle (OMPI) - Geneve, Suisse 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

^ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 
Ql FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

Q LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



